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(54) IMAGE TRANSMITTER, IMAGE RECEIVER, SYSTEM AND METHOD 
FOR PICTURE COMMUNICATION 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an image transmitter, an image receiver, 
a system and a mettiod for picture communication with whicfi liigh picture quality 
display is enabled wliile freely setting tlie desired part to be watched on the side 
of reception on an image fetched on the side of transmission without changing 
the transmission time of compressed image. 

SOLUTION: By setting compression for transmitting the compressed data of cut 
images for a prescribed time from the image size of cut display range and the 
transmission rate of the transmission system set on an image reception side 117 
through a compression setting means 106 on an image transmission side 116, 
while securing the transmission time of the image compressed data constant, 
the image fetched on the image transmission side 116 can be displayed with 
high picture quality while freely setting the desired part to be watched on the 
image reception side 117. 
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CLAIMS 
[Claim(s)] 

[Claim 1] The image pick-up means which photographs an image, and a 
receiving means to receive the display rectangle data transmitted from the 
image receiving set through the transmission system, The image cutoff means 
which cuts off the image of the range which the display rectangle data obtained 
from the image photographed from said image pick-up means with said 
receiving means show, A transmission rate setting-out means to set up the 
transmission rate of said transmission system, and a compressibility setting-out 
means to set up the rate of picture compression based on the transmission rate 
set up by the image size cut off with said image cutoff means, and said 
transmission rate setting-out means, The image sending set characterized by 
having a picture compression means to compress the image cut off with said 
image cutoff means with the compressibility set up by said compressibility 
setting-out means, and a transmitting means to transmit the compression image 
obtained with said picture compression means to said image receiving set. 
[Claim 2] The image sending set which carries out [ having a 
picture-compression means compress the image which cut off with the image 



cutoff means which cuts off the image of the range which the display-rectangle 
data which obtained with said receiving means show, and said image cutoff 
means from the image which photographed from the image pick-up means 
which photographs an image, a receiving means receive display-rectangle data 
from an image receiving set, and said image pick-up means, and the transmitting 
means transmit the compression image which obtained with said 
picture-compression means to said image receiving set, and ] as the description. 
[Claim 3] A receiving means to receive a compression image from an image 
sending set, and an image expanding means to elongate the compression 
image received with said receiving means, An image amplification means to 
expand the image elongated with said image expanding means, and an image 
display means to display the image expanded with the image elongated with 
said image expanding means, or said image amplification means, The image 
receiving set characterized by having a display rectangle setting-out means to 
set up the display rectangle of the arbitration in the image displayed by said 
image display means, and a transmitting means to transmit the display rectangle 
data set up with said display rectangle setting-out means to said image sending 
set. 

[Claim 4] The image pick-up means which photographs an image, and a 
receiving means to receive the display rectangle data transmitted from the 



image receiving set through the transmission system, The image cutoff means 
which cuts off the image of the range which the display rectangle data obtained 
from the image photographed from said image pick-up means with said 
receiving means show, A transmission rate setting-out means to set up the 
transmission rate of said transmission system, and a compressibility setting-out 
means to set up the rate of picture compression based on the transmission rate 
set up by the image size cut off with said image cutoff means, and said 
transmission rate setting-out means, A picture compression means to compress 
the image cut off with said image cutoff means with the compressibility set up by 
said compressibility setting-out means, The image sending set which has a 
transmitting means to transmit the compression image obtained with said picture 
compression means to said image receiving set, A receiving means to receive 
the compression image transmitted from said image sending set, and an image 
expanding means to elongate the compression image received with said 
receiving means. An image amplification means to expand the image elongated 
with said image expanding means, and an image display means to display the 
image expanded with the image elongated with said image expanding means, or 
said image amplification means, The image communication system 
characterized by providing the image receiving set which has a display rectangle 
setting-out means to set up the display rectangle of the arbitration in the image 



displayed by said image display means, and a transmitting means to transmit the 
display rectangle data set up with said display rectangle setting-out means to 
said image sending set. 

[Claim 5] The image pick-up means which photographs an image, and a 
receiving means to receive the display rectangle data transmitted from the 
image receiving set, The image cutoff means which cuts off the image of the 
range which the display rectangle data obtained from the image photographed 
from said image pick-up means with said receiving means show, A picture 
compression means to compress the image cut off with said image cutoff means 
with the compressibility set up by said compressibility setting-out means, The 
image sending set which has a transmitting means to transmit the compression 
image obtained with said picture compression means to said image receiving set, 
A receiving means to receive the compression image transmitted from said 
image sending set, and an image expanding means to elongate the 
compression image received with said receiving means. An image amplification 
means to expand the image elongated with said image expanding means, and 
an image display means to display the image expanded with the image 
elongated with said image expanding means, or said image amplification means. 
The image communication system characterized by providing the image 
receiving set which has a display rectangle setting-out means to set up the 



display rectangle of the arbitration in the innage displayed by said image display 
means, and a transmitting means to transmit the display rectangle data set up 
with said display rectangle setting-out means to said image sending set. 
[Claim 6] In the approach of performing pictorial communication between an 
image sending set and an image receiving set through a transmission system 
said image sending set The image of the range which the display rectangle data 
received from said image receiving set show is cut out from the image 
photographed with image pick-up equipment. Based on the size of this cut-off 
image, and the transmission rate of said transmission system set up beforehand, 
set up compressibility, and said cut-off image is compressed with this 
compressibility. While transmitting to said image receiving set, said image 
receiving set The pictorial communication approach characterized by 
transmitting this display rectangle data to said image sending set when the 
compression image received from said image sending set is elongated, the 
image to which this elongated image or elongated image was expanded is 
displayed and the display rectangle of arbitration is set up in this displayed 
image. 

[Claim 7] In the approach of performing pictorial communication between an 
image sending set and an image receiving set through a transmission system 
said image sending set The image of the range which the display rectangle data 



received from said image receiving set show is cut out from the image 
photographed with image pick-up equipment. While compressing this cut-off 
image and transmitting to said image receiving set, said image receiving set The 
pictorial communication approach characterized by transmitting this display 
rectangle data to said image sending set when the compression image received 
from said image sending set is elongated, the image to which this elongated 
image or elongated image was expanded is displayed and the display rectangle 
of arbitration is set up in this displayed image. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the pictorial communication 
approach at image communication systems, such as a TV phone system using a 
picture compression coding technique, the image sending set which constitutes 
an image communication system in a list and an image receiving set. and a list. 
[0002] 

[Description of the Prior Art] In recent years, in the field of multimedia, the TV 



phone system which is one of the image communication systems using a picture 
compression coding technique attracts attention. As a TV phone system using 
such a picture compression coding technique, what was indicated by 
JP,5-268596,A is mentioned, for example. 

[0003] In this TV phone system, to the image photographed with the camera in 
the transmitting side, resolution conversion, compression, etc. shall be 
performed, it shall transmit to a receiving side, and the received compression 
image shall be elongated and displayed at the receiving side. Based on the 
control signal by which it is sent from a receiving side through a circuit, and 
comes, actuation control of each device for adjusting the zoom and position of a 
camera of a transmitting side is carried out. That is, in a receiving side, if there is 
range to see further out of a display image, the zoom and position of a camera of 
a transmitting side will be adjusted in the image of the appointed range by 
specifying the range to the condition in which a photograph lump is possible. 
Moreover, the rate of picture compression of the transmitting side which 
influences the image quality of a display image has made a setting-out change 
at arbitration according to the directions from a receiving side. 
[0004] 

[Problem(s) to be Solved by the Invention] However, in such an image 
communication system, in order to photograph with a camera the image of the 



range which a receiving side requires, along with the camera of a transmitting 
side, mechanical device [ a zoom device, a position adjustment device, etc. ] 
structure is needed, and there is a fault that hardware magnitude increases. 
[0005] Moreover, although actuation which lowers compressibility is performed 
in order to raise the image quality of a display image if needed, the time of 
zoom-in etc. In this case, the amount of transmissions of picture compression 
data increases, and the situation where picture compression data cannot be 
transmitted in the time amount which it is originally going to transmit arises from 
relation with the throughput (transmission rate) of a transmission system. When 
compressibility is gathered similarly, the amount of transmissions of picture 
compression data decreases, and there is a problem of finishing transmission 
earlier than original time amount. 

[0006] This invention was made in view of such a technical problem, is smaller 
hardware magnitude and aims at offer of the image sending set which can set up 
freely a part to see by the receiving side to the image photographed by the 
transmitting side, and can display it, an image receiving set, an image 
communication system, and an image correspondence procedure. 
[0007] Moreover, this invention aims at offer of the image sending set which can 
set up freely a part to see by the receiving side to the image photographed by 
the transmitting side, and can indicate by high-definition, an image receiving set. 



an image communication system, and an image correspondence procedure, 
without bringing fluctuation to the transmission time of a compression image. 
[0008] 

[Means for Solving the Problem] An image pick-up means by which this 
invention photographs an image in order to attain the above-mentioned object, A 
receiving means to receive the display rectangle data transmitted from the 
image receiving set through the transmission system, The image cutoff means 
which cuts off the image of the range which the display rectangle data obtained 
from the image photographed from the image pick-up means with the receiving 
means show, A transmission rate setting-out means to set up the transmission 
rate of a transmission system, and a compressibility setting-out means to set up 
the rate of picture compression based on the transmission rate set up by the 
image size and the transmission rate setting-out means which were cut off with 
the image cutoff means, A picture compression means to compress the image 
cut off with the image cutoff means with the compressibility set up by the 
compressibility setting-out means. The image sending set which has a 
transmitting means to transmit the compression image obtained with the picture 
compression means to an image receiving set, A receiving means to receive the 
compression image transmitted from the image sending set, and an image 
expanding means to elongate the compression image received with the 



receiving means, An image amplification means to expand the image elongated 
with the image expanding means, and an image display means to display the 
image expanded with the image or image amplification means elongated with 
the image expanding means. It comes to provide the image receiving set which 
has a display rectangle setting-out means to set up the display rectangle of the 
arbitration in the image displayed by the image display means, and a 
transmitting means to transmit the display rectangle data set up with the display 
rectangle setting-out means to an image sending set. 

[0009] That is, it becomes possible to set up freely a part to see by the receiving 
side to the image photographed by the transmitting side, and to display by high 
definition, without bringing fluctuation to the transmission time of picture 
compression data from the cut-off image size and the transmission rate of a 
transmission system by this invention by setting up the compressibility which can 
transmit the compressed data of the cutoff image to predetermined time. 
[0010] Moreover, in this invention, if the display rectangle of an image to see by 
the receiving side is set up, since the image of the display rectangle will be cut 
down and compressed and it will be transmitted in a transmitting side, it 
becomes possible to eliminate the mechanical structure which accompanies an 
image pick-up means in the hardware configuration of a transmitting side. 
[0011] 



[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention 
is explained. 

[0012] Drawing 1 is the block diagram showing the TV phone structure of a 
system which is the operation gestalt of this invention. 

[0013] As shown in this drawing, the image transmitting side 116 of this TV 
phone system CCD101 which is the image pick-up means which photographs an 
image, and a receiving means 105 to receive the display rectangle data 
transmitted from the image receiving side 117 through the circuit 115, The image 
range cutoff means 102 which cuts off the image of the range which the display 
rectangle data obtained from the image photographed from CCD101 with the 
receiving means 105 show, A transmission rate setting-out means 107 to set up 
the transmission rate of a transmission system (circuit 114), A compressibility 
setting-out means 106 to set up the rate of picture compression based on the 
transmission rate set up with the image size and the transmission rate 
setting-out means 107 which were cut off with the image range cutoff means 102, 
It has a picture compression means 103 to compress the image cut off with the 
image range cutoff means 102 with the compressibility set up by the 
compressibility setting-out means 106, and a transmitting means 104 to transmit 
the compression image obtained with the picture compression means 103 
through a circuit 114 to the image receiving side 117, and is constituted. 



[0014] A receiving means 108 to, receive the connpression image with which the 
image receiving side 117 was transmitted from the image transmitting side 116 
through the circuit 114 on the other hand, An image expanding means 109 to 
elongate the compression image received with the receiving means 108, An 
image amplification means 110 to expand the image elongated with the image 
expanding means 109, An image display means 111 to display the image 
expanded with the image amplification means 110, It has a display rectangle 
setting-out means 112 to set up the display rectangle of the arbitration in the 
image displayed by the image display means 111, and a transmitting means 113 
to transmit the display rectangle data set up with the display rectangle 
setting-out means 112 through a circuit 115 to the image transmitting side 116, 
and is constituted. 

[0015] In addition, the image display means 111 can also display the image 
inputted without being expanded besides the image expanded with the image 
amplification means 110. 

[0016] Next, actuation of the TV phone system which has such a configuration is 
explained. 

[0017] Actuation of the image transmitting side 116 is first explained with 
reference to the flow chart of drawing 2 etc. An image is first photographed by 
CCD101 (step 21). Here, the image range cutoff means 102 checks the 



receiving existence of the display rectangle data received through a check (step 
22) 105, i.e., a receiving means, in the existence of the display rectangle 
assignment from the image receiving side 117, or its content. If there is no 
display rectangle assignment from the image receiving side 117, the image 
photographed by CCD101 will be sent to the picture compression means 103 as 
it is, will be compressed with this compressibility after setting up compressibility 
(step 24) (step 25), and will be transmitted to the image receiving side 1 17 by the 
transmitting means 104. For example, in early actuation, in this way, it is 
compressed as it is and transmitted to the image receiving side 117, and an 
image will be displayed, without being expanded after expanding by the image 
receiving side 117, for example. 

[0018] Moreover, when there is display rectangle assignment from the image 
receiving side 117, the image range cutoff means 102 cuts off the image of the 
range which corresponds from the image photographed by CCD101 according 
to the content (display rectangle data) of that display rectangle assignment, and 
sends the image of this cut-off range to the picture compression means 103. 
[0019] The example of image cutoff is shown in drawing 3 . 31 is the whole 
image pick-up range image of CCD101, the range as shown in 32 or 33 to such 
a whole image 31 is set up by the image receiving side 117, and cutoff of the 
range 32 or the image of 33 is performed by the image range cutoff means 102 



here. 

[0020] The compressibility setting-out means 106 reads a transmission rate from 
a transmission rate setting-out means 107 by which the transmission rate of a 
transmission system is stored beforehand, and computes compressibility from 
these images size and a transmission rate while it asks for the image size of the 
display rectangle based on the display rectangle data set up by the image 
receiving side 117. The transmission rate of a transmission system can be set up 
here according to the specification of the modem used, for example etc. 
[0021] Here, the calculation approach of compressibility is described. 
[0022] When the transmission rate of A [a bit] and a transmission system tends 
to be set to B [the bits per second] for the amount of data of the image 
photographed from CCD101 and it is going to transmit a compression image in t 
seconds, compressibility CO is C0=Bxt/A (formula 1) 

It becomes. This compressibility CO is used as compressibility at the time of 
compressing the image photographed by CCD101 as it is, and transmitting it. 
[0023] Therefore, it is compressibility C in order to transmit the P pixels in t 
seconds by B [the bits per second], if image size photographed from CCD101 is 
made into PO pixel and image size of the display rectangle cut off with the image 

range cutoff means 102 is made into P pixels C=COx (PO/P) (formula 2) 

Then, it is good. 



[0024] However, since the case where compressibility becomes one or more can 
be considered if the cutoff display rectangle of an image becomes small as 
shown in drawing 4 , it is necessary to establish the upper limit of compressibility 
like C<=1 in this case. Moreover, as long as the upper limit of compressibility 
becomes one or less, it may be set up freely. Moreover, if the cutoff display 
rectangle of an image becomes large too much, in order for compressibility to 
approach 0 infinite, it is necessary to prepare the minimum of compressibility 
similarly. 

[0025] Thus, the compressibility C set up with the compressibility setting-out 
means 106 is sent to the picture compression means 103. The picture 
compression means 103 is the compressibility C, and compresses the image of 
the display rectangle cut off by the image range cutoff means 102. 
[0026] Drawing 5 explains picture compression about this JPEG compression in 
a line crack by JPEG compression which is - ** of for example, the still picture 
compression approach. 

[0027] An input image is divided into a 8x8-pixel block, it is inputted into a DCT 
means 401 to perform DCT (Discrete Cosine Transform, discrete cosine 
transform) etc., and a 8x8-pixel block is rearranged into a frequency component 
in this DCT means 401. The rearranged block (DCT multiplier) is inputted into a 
scanning means 402 to change two-dimensional data into 1 -dimensional data. 



The data changed into 1 -dimensional data are rounded off after a division is 
done by the nnultiplier corresponding to a quantization matrix table in the 
quantization means 403. This actuation is performed to all the pixels in input 
block. Thereby, the 1st-step compression processing (lossy compression) is 
performed. By carrying out variable length coding of the quantized data with 
reference to the Huffman table in the VLC means 404, the 2nd-step compression 
processing (lossless compression) is performed, with the compressed data of a 
block is obtained. Final compressed data is obtained by performing the above 
actuation to all blocks of an input image. When the amount of data of 
compressed data does not become predetermined compressibility, by the rate 
control means 405, it changes to other quantization matrix tables, and 
compression processing is repeated. This obtains the compressed data of the 
predetermined amount of compression. 

[0028] Thus, the obtained picture compression data are sent out to a circuit 114 
by the transmitting means 104. 

[0029] As mentioned above, it becomes possible to set up freely a part to see by 
the image receiving side 117 to the image photographed by the image 
transmitting side 1 16, and to display by high definition, securing the transmission 
time of picture compression data from the cut-off image size and the 
transmission rate of a transmission system uniformly by setting up the 



compressibility which can transmit the compressed data of that cutoff image to 
predetermined time according to the configuration of the image transmitting side 
1 16 of the TV phone system of this operation gestalt. 

[0030] Next, actuation of the image receiving side 117 is explained with 
reference to the flow chart of drawing 6 etc. The picture compression data 
received with the receiving means 108 through the circuit 114 by step 61 are 
sent to the image expanding means 109, and expanding is performed (step 62). 
[0031] Image expanding is performed by for example, JPEG expanding. Drawing 
7 explains this JPEG expanding. 

[0032] With reference to the Huffman table, the variable-length decryption of the 
picture compression data is first carried out with the VLD means 501 as the 
Ist-step expanding processing. Reverse quantization is performed by carrying 
out multiplication to this data for each [ which corresponds with reference to a 
quantization matrix table with the reverse quantization means 502 ] multiplier of 
every. The block data by which reverse quantization was carried out is changed 
into two-dimensional block data from 1 -dimensional data in the reverse scan 
means 503. Block data is restored to the original image data by the reverse DCT 
operation in the reverse DCT means 504, and, thereby, the 2nd-step expanding 
processing is performed. And an image is restored by performing these 
actuation to all blocks that constitute a screen. 



[0033] Thus, when the elongated image performs digital signal processing in the 
image amplification means 11Q, amplification, i.e., digital zoom processing, is 
performed to the image size which an addressee wishes (step 63). As shown in 
drawing 4 here, since compressibility becomes so small that the image size cut 
out from the image captured from CCD 102 becomes small, high definition is 
changed [ sharply ] the image quality of an amplification image with image size 
and obtained on the average. 

[0034] The expanded image is displayed on the image display means 111 (step 
64). Here, the addressee who looked at the image can extend the range to see 
by operating the display rectangle setting-out means 112, or can specify the still 
smaller range (step 65). By the transmitting means 113, the specified display 
rectangle is sent out to a circuit 115, and is sent to the receiving means 105 of 
the image transmitting side 116 (step 66). Henceforth, the above-mentioned 
actuation will be repeated by the image transmitting side 116 and the image 
receiving side 117. 

[0035] In addition, although the graphic display was omitted about audio 
transmission and reception, it is preparing the both sides of a transmitting side 
and a receiving side a voice transmitter-receiver, and it becomes possible to 
transmit voice data through circuits 114 and 115. Moreover, the circuit for voice 
transmission may be another circuit in the circuits 114 and 115 for picture 



transmissions. 

[0036] Moreover, although JPEG was illustrated as the approach of picture 
compression expanding with this operation gestalt, it cannot be overemphasized 
that other compression expanding methods may be adopted. Furthermore, 
although this operation gestalt shows independently the transceiver means 104 
and 108 for picture transmissions and the circuit 1 14, and the transceiver means 
113 and 105 and circuit 115 for transmission of display rectangle data etc., it is 
very good in a configuration which packs a transceiver means into one and 
transmits all data using one circuit. 
[0037] 

[Effect of the Invention] It becomes possible to set up freely a part to see by the 
receiving side to the image photographed by the transmitting side, and to display 
by high definition, without bringing fluctuation to the transmission time of picture 
compression data by setting up the compressibility which can transmit the 
compressed data of the cutoff image to predetermined time from the cut-off 
image size and the transmission rate of a transmission system according to this 
invention, as explained above. 

[0038] Moreover, if the display rectangle of an image [ according to this 
invention ] to see by the receiving side is set up, since the image of the display 
rectangle will be cut down and compressed and it will be transmitted in a 



transmitting side, it becomes possible to eliminate tlie mechanical structure 
which accompanies an image pick-up means in the. hardware configuration of a 
transmitting side. 
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[Drawing 1] The block diagram showing the TV phone structure of a system 
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[Drawing 2] The flow chart for explaining actuation of the image transmitting side 
of drawing 1 

[Drawing 3] Drawing showing the example of image cutoff of the image 
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[Drawing 7] The block diagram showing the example of the image expanding 
means of the image receiving side of drawing 1 
[Description of Notations] 

101 .... Image pick-up means 

102 .... Image range cutoff means 

103 .... Picture compression means 

104 .... Transmitting means 

105 .... Receiving means 

106 .... Compressibility setting-out means 

107 .... Transmission rate setting-out means 

108 .... Receiving means 

109 .... Image expanding means 

110 .... Image amplification means 

1 1 1 .... Image display means 

112 .... Display rectangle setting-out means 

113 .... Transmitting means 
114,115 .... Circuit 

116 .... Image transmitting side 

117 .... Image receiving side 



